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5 METHOD AND APPARATUS FOR 

INTERFACING WITH INTELLIGENT 
THREE-DIMENSIONAL COMPONENTS 

Inventors: 

10 Patrick Lynn, John Fairley, Kamal Shah, Clay Graham 

COPYRIGHT NOTICE 
A portion of the disclosure of this patent document contains material which 
15 is subject to copyright protection. The copyright owner has no objection to the 

facsimile reproduction by anyone of the patent document or the patent disclosure, 
as it appears in the Patent and Trademark Office patent file or records, but 
otherwise reserves all copyright rights whatsoever. 

20 BACKGROUND OF THE INVENTION 

Field Of The Invention 

The present invention relates generally to interactive multimedia, and more 
particularly, to a method and apparatus for interfacing with intelligent three- 
dimensional objects. 

25 

Description of Related Art 

The term "multi media" includes many technologies such as video and 
interactive three-dimensional ("3D") technology. Interactive 3D has gained recent 
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popularity due to numerous benefits over two-dimensional technology as well as 
advantages over plain text or video. First, interactive 3D is unlike a 3D movie in 
that interactive 3D contains content that is an interactive experience. That is, 3D 
content, used in conjunction with a computer, enables a user to move objects on the 
screen and explore different spaces on the screen. A user is able to independently 
examine objects and wander throughout a "world," i.e. a 3D space. For example, 
a typical training video teaching a person how to assemble a part would be rerun 
several times in order to fully understand the assembly process. However, using 
interactive 3D, a user assembles the item and then may take the item apart and put 
the item back together until the assembly process is truly understood. A second 
advantage of using interactive 3D is that a user' s viewpoint belongs to the user, not 
to the author of the content. Thus, a user may rotate an object or walk around the 
object to change the view angle. Thirdly, a user may also view objects in different 
sequences as opposed to watching such objects sequentially which is what occurs 
in a video. 

Even with the popularity of interactive 3D, the widespread use of interactive 
3D is limited by storage, delivery and application integration limitations of present- 
day interactive 3D. 3D content, which is generally the programming language 
creating a 3D object, is typically stored as a file on a server and then visualized to 
a user by an application ("plug-in") over a data network, such as the Internet. This 
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model is known as a file server model. In general, the file server model is shown in 
prior art FIG. 1 within the dashed line 15, Prior art FIG. 1 is a block diagram view 
of a typical use of 3D content 10. In FIG 1, the file server model 15 includes the 
3D content 10 developed by a content developer in a programming language. The 
3D content is typically written in a programming language known as Virtual Reality 
Modeling Language ("VRML"). A description of VRML is available in the 
publication "The Virtual Reality Modeling Language," ISO/IEC 14772-1: 1997, 
incorporated herein by reference. A brief example of VRML is provided below in 
prior art FIG. 2. Returning to prior art FIG. 1, the content developer prepares, in 
VRML, a file that contains the 3D content to be viewed, A browser on the Internet 
100 that wishes to view the 3D content 10 uses a "plug-in" application 90 that is 
generally loaded into the browser on the Internet 100 in order to visualize the 3D 
content 10 stored as a file. 

A problem with the 3D content stored as a file is that such 3D content is not 
able to be accessed by a user, such as an application developer 50, that wishes to 
create an application to interact with the 3D content 10, unless such developer 
knows VRML. In essence, the 3D content 10 written in VRML is opaque, or not 
accessible by the application developer, who wishes to use the 3D content to create 
a packaged software product 70. Thus, the storage and delivery of the 3D content 
as a file is a limitation of the file server model since application developers must 
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know VRML to interact with the 3D content. 

Prior art FIG. 2 is a brief example of VRML that demonstrates the type of 
understanding of VRML needed by an application developer to create an application 
that interfaces with 3D content. Prior art FIG. 2 is an example of VRML defining 
a box 110. In FIG. 2, the 3D content 10 defines the box 110 that an application 
developer 50 would wish to incorporate into a graphical scene as part of a packaged 
software product 70 (FIG. 1). To permit the application developer 50 to use the 3D 
content 10 in the packaged software product 70 being developed, the application 
developer 50 must be sufficiently familiar with VRML. 

VRML is a sophisticated programming language that many application 
developers 50 may not understand. In FIG 2, a box 1 10 is defined by the VRML 
below the box 1 10, In general, the box 1 10 is considered an object that the VRML 
is able to create, change properties of and connect with other objects. At section 
115, VRML has created a new object labeled DEF BOX GRP. In the next section 
120, the Properties 120 of the box are defined and changed. Specifically, at VRML 
line 13 0 7 the box is translated to a certain 3D coordinate (4 .2 1.) At VRML line 
140, the box is rotated to a certain orientation (0 11 .9). At VRML line 150, a 
subgroup labeled Children is defined to include a shape, at VRML line 160, having 
the geometry of a box, at VRML line 170, and a particular appearance from VRML 
line 180. A certain material at VRML 190 is then defined including a particular 
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color. A third section would then create a Route 125 that would match, move or 
coordinate the box 110 with other objects within the graphical scene of the plugin 
application (FIG. 1). Thus, VRML provides 3D content that contains Groups 115, 
Properties 120 and Routes 125 that permit the box 1 10 to be defined. 

However, even if the application developer 50 (FIG. 1) is somewhat familiar 
with VRML, the integration of the 3D content 1 0 to the application being developed 
by the application developer 50 to create a packaged software product 70 is very 
difficult due to the complexity of VRML. An application developer must study the 
VRML to locate the 3D content needed and integrate those fields into the 
application being developed. This process is very complicated and time consuming. 
A need therefore exists for a user to be able to quickly and easily access different 3D 
content in VRML without knowing VRML or having to locate specifications and 
operations in the 3D content. 

One attempted solution to this application integration problem has been the 
use of an External Authoring Interface (EAI). A description of EAI is available in 
the publication "External Authoring Interface " ISO/IEC 14772-1 : 1997 Appendix 
B ? incorporated herein by reference, EAI has attempted to expose the 3D content 
to the application but has failed to provide a generic method for providing 
application integration. EAI has failed since EAI, like VRML itself, is very 
complicated and difficult to understand. A second problem with EAI is that it is 
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limited in scene graph management. That is, EAI is not able to maintain direct 
pointers to objects in a scene and is also not able to determine the properties of an 
object unless the application developer knows the complex VRML. Thirdly, EAI 
does not provide the application developer with the ability to easily interface with 
the Groups, Properties and Routes of each object in the 3D content. EAI therefore 
has application integration limitations that does not solve the need for the 
integration between 3D content and an application being developed by an 
application developer (or user) wishing to interface with the 3D content. 

A second proposed solution to this application integration problem has been 
attempted by Microsoft Corporation of Redmond, Washington in a product 
commercially known as Chromeffects™. Chromeffects™ is an interactive media 
technology that is intended to improve the quality and performance of interactive 
media for the Internet and desktop applications. Chromeffects™ is based on 
HyperText MarkUp Language (HTML) and Extensible Markup Language (XML) 
and represents 3D content in a "component" model. A component model to 3D 
content is an evolution from the object-oriented model that has previously been 
used. The component model to 3D content treats a 3D object as a simple 
component by exposing only a group of basic functions to describe the 3D object. 
That is, while the object-oriented model provides to a user all details of an object 
to be modeled, a component approach only provides to the user a particular set of 
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functions that functionally and simply describe the object in order to simplify the 
interaction between the user and the object, 

A problem with Chromeffects™ is that the 3D content, based on HTML and 
XML ? needs additional external scripting and interface scripting to provide the 
needed set of functions. Thus, the 3D content, created in HTML and XML, is not 
"intelligent," i.e. intrinsically contained within the 3D content, but instead needs 
additional content scripting and interface scripting. Such additional scripting takes 
more time and comes at a higher cost and complexity. Thus, Chromeffects™ is 
limited by the additional scripting or "intelligence" provided by the scripting to 
properly integrate the 3D content to an application. 

A need therefore remains to provide an interface to 3D content that does not 
require a user to know VRML and that does not require additional external and 
interface scripting. 

SUMMARY OF THE INVENTION 
The present invention, as described herein, provides a method of interfacing 
with a three-dimensional object that is displayed. The method includes the steps of 
defining the three-dimensional object as a component having a component interface, 
displaying the component interfaces and then interfacing with the three-dimensional 
object through the component interfaces. The component intrinsically contains an 
intelligent content. 
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The present invention also provides for an apparatus for interfacing with the 
three-dimensional object that is displayed by providing means for performing each 
step of the method described. 

Also provided herein are alternative embodiments for the present invention 
including a computer system for interfacing with the three-dimensional object that 
is displayed that includes a display means, a memory for storing a computer program 
for interfacing with the three-dimensional object displayed on a display means and 
a processor for executing the computer program in conjunction with the display 
means. The computer program is executed to perform the method of interfacing 
with the three-dimensional object that is displayed. 

The present invention also provides for a computer-readable medium that 
has a computer program stored on the medium so that, when the medium is loaded 
onto a computer, the computer is caused to perform a function of interfacing with 
a three-dimensional obj ect displayed on the computer. The computer interfaces with 
the three-dimensional object by performing the steps of defining the three- 
dimensional object as a component with a component interface, displaying the 
component interface and interfacing with the three-dimensional object through the 
component interface. The component intrinsically contains an intelligent content. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The present invention will be described with respect to particular 
embodiments thereof, and reference will be made to the drawings in which like 
numbers designate like parts and in which: 

FIG. 1 is a prior art block diagram view of the typical use of 3D content; 

FIG. 2 is a prior art VRML representation of a box; 

FIG. 3 is a high- level block diagram of a computer system incorporating the 
method of interfacing of the present invention; 

FIG 4 is a block diagram view of an embodiment of the method of 
interfacing with a three-dimensional object of the present invention; and 

FIG. 5 is a flow chart of the method of interfacing with a three-dimensional 
object of the present invention. 

DETAILED DESCRIPTION 

In the following description, various embodiments of the method of the 
present invention for interfacing with intelligent 3D components will be provided. 
Alternative embodiments of the present invention will also be provided that identify 
practical applications of the present invention. Thus, while the present invention is 
directed to a method of interfacing with a three-dimensional object that is displayed, 
alternative embodiments implementing that method, including an apparatus, a 
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computer system and a computer-readable medium, are also provided to practically 
apply and functionally detail the method of the present invention. It is understood, 
however, that the present invention is generally directed to a method of interfacing 
with a 3D object that is displayed by performing the steps of defining the three- 
dimensional object as a component with a component interface, displaying the 
component interface and interfacing with the 3D object through the component 
interface. The component intrinsically contains an intelligent content. The present 
invention will now be described in detail with reference to FIGs. 3-5. 

FIG. 3 illustrates a high-level block diagram of a computer system which is 
used, in one embodiment, to implement the method of the present invention. The 
computer system 246 of FIG. 3 includes a processor 230 and memory 225. 
Processor 230 may contain a single microprocessor, or may contain a plurality of 
microprocessors for configuring the computer system as a multi-processor system. 
Memory 225, stores, in part, instructions and data for execution by processor 230. 
If the system of the present invention is wholly or partially implemented in software, 
including a computer program, memory 225 stores the executable code when in 
operation. Memory 225 may include banks of dynamic random access memory 
(DRAM) as well as high speed cache memory. 

The system of FIG. 3 further includes a mass storage device 23 5, peripheral 
device(s) 240, input device(s) 255, portable storage medium drive(s) 260, a graphics 
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subsystem 270 and a display 285. For purposes of simplicity, the components 
shown in FIG. 3 are depicted as being connected via a single bus 280. However, the 
components may be connected through one or more data transport means. For 
example, processor 230 and memory 225 may be connected via a local 
microprocessor bus, and the mass storage device 23 5 , peripheral device(s) 240, 
portable storage medium drive(s) 260, and graphics subsystem 270 may be 
connected via one or more input/output (I/O) buses. Mass storage device 235, 
which is typically implemented with a magnetic disk drive or an optical disk drive, 
is a non-volatile storage device for storing data and instructions for use by processor 
23 0. In another embodiment, mass storage device 23 5 stores the computer program 
implementing the method of the present invention for interfacing with a three- 
dimensional object for purposes of loading such program to memory 225. The 
method of the present invention also may be stored in processor 230. 

Portable storage medium drive 260 operates in conjunction with a portable 
non-volatile storage medium, such as a floppy disk, or other computer-readable 
medium, to input and output data and code to and from the computer system of 
FIG. 3 . In one embodiment, the method of the present invention for interfacing with 
a three-dimensional object is stored on such a portable medium, and is input to the 
computer system 246 via the portable storage medium drive 260. Peripheral 
device(s) 240 may include any type of computer support device, such as an 
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input/output (I/O) interface, to add additional functionality to the computer system 
246. For example, peripheral device(s) 240 may include a network interface card 
for interfacing computer system 246 to a network, a modem, and the like. 

Input device(s) 255 provide a portion of a user interface. Input device(s) 
25 5 may include an alpha-numeric keypad for inputting alpha-numeric and other key 
information, or a pointing device, such as a mouse, a trackball, stylus or cursor 
direction keys. Such devices provide additional means for interfacing with the 
three-dimensional obj ects in the method of the present invention. In order to display 
textual and graphical information, the computer system 246 of FIG. 3 includes 
graphics subsystem 270 and display 285. Display 285 may include a cathode ray 
tube (CRT) display, liquid crystal display (LCD), other suitable display devices, or 
means for displaying, that enables a user to view a three-dimensional object. 
Graphics subsystem 270 receives textual and graphical information and processes 
the information for output to display 285. Display 285 can be used to display a 
three-dimensional obj ect, component interfaces and/or display other information that 
is part of a user interface. The display 285 provides a practical application of the 
method of interfacing with a three-dimensional object of the present invention since 
the method of the present invention may be directly and practically implemented 
through the use of the display 285. The system 246 of FIG. 3 also includes an audio 
system 250. In one embodiment, audio system 250 includes a sound card that 
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receives audio signals from a microphone that may be found in peripherals 240. 
Additionally, the system of FIG. 3 includes output devices 245. Examples of 
suitable output devices include speakers, printers, and the like. 

The devices contained in the computer system of FIG. 3 are those typically 
found in general purpose computer systems, and are intended to represent a broad 
category of such computer components that are well known in the art. The system 
of FIG. 3 illustrates one platform which can be used for practically implementing the 
method of the present invention. Numerous other platforms can also suffice, such 
as Macintosh-based platforms available from Apple Computer, Inc., platforms with 
different bus configurations, networked platforms, multi-processor platforms, other 
personal computers, workstations, mainframes, navigation systems, and the like. 

Alternative embodiments of the use of the method of the present invention 
in conjunction with the computer system 246 further include using other display 
means for the monitor, such as CRT display, LCD display, projection displays, or 
the like. Likewise, any similar type of memory, other than memory 225, may be 
used. Other interface means, in addition to the component interfaces, may also be 
used including alpha-numeric keypads, other key information or any pointing 
devices such as a mouse, trackball, stylus, cursor or direction key. 

FIG. 4 is a block diagram view of an embodiment of the method of 
interfacing with a three-dimensional object of the present invention. In FIG. 4, a 
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sample three-dimensional object 340 is shown to be a cube. Such a three- 
dimensional object is displayed in any display means, including CRT display, LCD 
display, projection displays, monitors or the like. It is understood, however, that the 
three-dimensional object to be interfaced with using the method of the present 
invention may be any three-dimensional object. The three-dimensional object 340 
is defined as a component using a three-dimensional content language, such as 
VRML. 3D content 300 is the programming language equivalent of a 3D object 
340 viewed. By defining the 3D object as a component, the component is treated 
as a simple component, rather that a detailed object such as is used in an object- 
oriented description of a 3D object. In an alternative embodiment, the 3D content 
language is any virtual reality programming language that is "intelligent", that is, 
does not require additional scripting for content or interfacing with applications. It 
is understood, however, that other 3D content languages may be used as long as 
that 3D content language intrinsically contains an "intelligent" content, i.e., no 
additional external scripting or interface scripting is required to interface or access 
the 3D content. "Intelligent" 3D content is therefore 3D content that contains, 
intrinsically, within the language, the necessary content to interface with a user, 
without the need for additional scripting. The 3D content 300 is typically prepared 
by a content developer (not shown). In one embodiment, the 3D content 300 is 
practically implemented in a device of the computer system 246 (FIG. 3) in, for 
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example, the memory 225 of the computer system of FIG. 3. It is further 
understood that the 3D content 300 as well as the computer program 310, the EAI 
315 and the COM wrapper 320 may also all be located within the memory. 
However, it is understood that the 3D content 300 may also be stored in portions 
of the computer system of FIG. 3 that are capable of containing memory such as (in 
FIG. 3) processor 23 0, mass storage device 235 and portable storage medium 
drive(s) 260. 

Computer program 310 contains executable software that generates the 
component interfaces 331, to the 3D content 300, using the EAI 315 and COM 
wrapper 320 bridges. As previously discussed, the computer program 3 10 is, in one 
embodiment, located on the various storage means of FIG. 3 (e.g., memory 225, 
mass storage 235 or portable storage 260). In other embodiments, computer 
program 310 may be located on a computer-readable medium, such as a floppy disk 
of other portable or non-portable storage device. In still further embodiments, as 
discussed below, the computer program 310 may be located on an electronic signal 
transferred over a network, such as the Internet. The computer program 310 
generates the component interfaces 331 on a display 285 and is able to interface 
with a user/application developer 330, through the component interfaces 33 1, to the 
3D content 300. The 3D content 300 uses the EAI 3 15 to expose a scene graph 
formed by the 3D content 300 to an application developer 330. A description of 
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EAI is available in the publication "External Authoring Interface", ISO/DEC 14772- 
1 : 1997 Appendix B, and is incorporated herein by reference. 

The COM wrapper 320, also stored in similar locations as computer 
program 3 10, such as memory 225, is a universal interface that "wraps" around the 
computer program 3 10 to permit the computer program 3 10 to communicate with 
the 3D content 300 through the EAI 315. The COM wrapper is an industry 
standard found in the publication, "The Component Object Model Specification," 
Draft Version 0.9, October 24, 1995 Microsoft Corporation and Digital Equipment 
Corporation, and is incorporated herein by reference. The 3D content 300, EAI 
315, computer program 3 10 and COM wrapper 320 are all located with storage of, 
for example, the computer system 246 or alternative storage devices as previously 
described. It is understood that the method of interfacing with a three-dimensional 
device of the present invention is practically implemented in one embodiment, in the 
computer system 246, but need not necessarily be implemented in such system as 
long as the method steps, as claimed below, are accomplished. 

The component interfaces 331 are part of the computer program 310, 
however are shown in FIG. 4 as separate from computer program 310 since the 
component interfaces are typically displayed in a display means 285, while the 
computer program 310 is not. The display means for displaying the component 
interfaces 331 includes a cathode ray tube (CRT) display, liquid crystal (LCD) 
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display, a monitor (such as a computer monitor), a projection screen or any other 
type of screen, or monitor device that visually displays the 3D object. The 
component interfaces 331 include group interface 338, pickable interface 332, 
transformable interface 333, colorable interface 334, texture interface 336 and other 
component interfaces 335. 

The component interfaces 331 provide the following functions to access 
particular content in 3D content 300. The pickable interface 332 provides access 
to mouse events in the 3D content 300, as such mouse events are commonly 
available in VRML. The transformable interface 333 provides access to the position, 
scale or rotation properties of the 3D content 300. The colorable interface 334 
provides access to the color and material properties of the 3D content 300. The 
texture interface 336 provides access to the application of images to the surface of 
the 3D content 300. The group interface 338 provides access to the manipulation 
of the object scene graph hierarchy as is commonly known in the art. 

These component interfaces are displayed on a display for a user such as 
the application developer 330 to interface with a three-dimensional object, such as 
object 340 (FIG. 3). A processor 230 is used to execute the computer program 3 10 
in conjunction with the display 285 in order to perform the method of the present 
invention. It is understood that while only a limited list of component interfaces is 
described herein, component interfaces may include an unlimited number of 
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interfaces that functionally describe a 3D object. An example of such component 
interfaces are provided in Table 2 below. 

The component interface 331 also includes other component interfaces 335 
which are known as extendable computer interfaces 335. The other component 
interfaces 335 permit an application developer or user to interface with the three- 
dimensional object in a manner other than the standard options listed as component 
interfaces 332-334, 336, 338. An extensive list of extension interfaces are provided 
in the example of Table 3 . The advantage of having extension interfaces is that the 
application developer 330 oruser is ableto interface with a three-dimensional object 
in a manner outside of the listed component interfaces 331. It is understood, 
however, that additional other component interfaces, for extending the interface 
with a user, may be used. 

In use, a 3D object 340 is displayed on a display means 235, such as a 
monitor, CRT display, LCD display, screen, projection device or the like. Along 
with the 3D object 340, the display 285 also displays the component interfaces 33 1 
through the use of processor 230 that executes the computer program 310 to 
display the component interfaces 33 1. A user, or application developer 330 who 
wishes to interface with the 3D object 340, is able to choose, from the component 
interfaces 331, which interface (332-336, 338) the user wishes to access. Upon 
choosing an interface, the computer program interfaces with the component 
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interfaces 33 1, through COM wrapper 320, and then interfaces with the 3D content 
300, through EAI 315, to access the appropriate "intelligent" content of the 3D 
content 300. An example of the 3D content 300 is shown in Table 1 below. 

Significant advantages exist for the method of the present invention. First, 
the application developer 330 need not know VRML (contained in the 3D content) 
and the application may easily interface with the VRML to interface with the three- 
dimensional object 340 to develop additional 3D applications to the 3D object. 
Second, the application developer or user need not do additional scripting in order 
to provide additional 3D content or for interfacing with the 3D content since the 3D 
content is "intelligent," that is the 3D content, or component, intrinsically contains 
an intelligent content. Thus, significant time saving occurs. Third, the embodiment 
of the method of the present invention shown in FIG. 4 permits a user to extend the 
component interfaces as shown by the other component interfaces 335. A user is 
therefore not limited by the "short list" of component interfaces 331. A further 
advantage of the present invention is that the three-dimensional object may be any 
object that is already defined in VRML 3D content 300 and, as such, is a component 
to which any of the component interfaces may apply regardless of the three- 
dimensional object to which an interface is necessary. 

Table 1 below is an example of the 3D content 300 of FIG. 4. The example 
is not intended to be either a compilable or executable program, a complete program 
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5 language or contain all the features discussed above. It is a VRML illustrative of 

the various functions and processes implemented in the method of interfacing of the 
present invention that is consistent with the principles of the above-described 
invention. Table 1, as well as Tables 2 and 3, are subject to copyright protection to 
the extent described above in the copyright notice. 

10 TABLE 1 

3D Content: 

PROTO SpinningBox 

15 [ 

#To store any proto info 

exposedField MFString protolnfo ["G3dBox"] 



20 



#Transform fields with default values 



#IG3dTransformableObj 

exposedField SFVec3f center 0 0 0 

exposedField SFVec3f translation 000 

exposedField SFRotation rotation 0 10 0 

25 exposedField SFVec3f scale 1 1 1 

exposedField SFRotation scaleOrientation 0 0 10 

field SFVec3f bboxCenter 00 0 

field SFVec3f bboxSize -1-1-1 

30 #IG3dGroup 

eventln MFNode addChildren 
eventln MFNode renioveChildren 
exposedField MFNode children [] 

35 #Material fields 

#IG3dCoioredObj 

exposedField SFFloat ambientlntensity 0.2 

exposedField SFColor diffiiseColor .8 .8 .8 

exposedField SFColor etnissiveColor 0 00 

40 exposedField SFFloat shininess 0.2 

exposedField SFColor specularColor 0 00 

exposedField SFFloat transparency 0 

#ImageTexture fields 
45 #IG3dTexture 

exposedField MFString url [] 

field SFBool repeats TRUE 

field SFBool repeatT TRUE 

50 #textureTransform fields 

exposedField SFVec2f centerTexture 0 0 

exposedField SFFloat rotationTexture 0 



Attorney Docket No. :PLAT1 005MCF/MAM 
mam/plat/1005/1005.006 



Express Mail No.TB687081879US 



-21 - 



5 exposedField SFVec2f scateTexture I 1 

exposedField SFVec2f translationTexture 0 0 

#TouchSensor 

10 #IG3dMouseEvents 

exposedField SFBool enabled FALSE 

eventOut SFBool isActive 

eventOut SFBool isOver 

eventOut SFTime touchTime 

1 5 eventOut SFVec3f hitPoint_changed 

#Box fields 
#IG3dBox 

field SFVec3f size 2 22 



20 



25 



#IG3dExtension 

exposedField SFBool animationEnabled FALSE 
exposedField SFFloat animationDuration 10 



^Extension MetaData describing the additional Extension properties 

exposedField MFString Properties 

[ 

"animationEnabled", "Enable the Animation", "SFBool", 
3 0 "animationDuration", "The duration of the animation", "SFFloat" 

1 

] 
{ 

3 5 DEF TRANSFORM Transform { 

center IS center 
translation IS translation 
rotation IS rotation 
scale IS scale 

40 scaleQrientation IS scaleOrientation 

bboxC enter IS bboxCenter 
bboxSize IS bboxSize 



45 children [ 

Shape { 

appearance Appearance { 

material Material { 
ambientlntensity IS ambientlntensity 
50 diffiiseColor IS diffuseColor 

ernissiveColor IS emissiveColor 
shininess IS shininess 
specularColor IS specularColor 
transparency IS transparency 

55 } 

texture ImageTexture { 

#for simplicity, no 
#MovieTextures or PixelTextures 
#we could expose the texture 
60 #node to all these 

url IS url 
repeats IS repeats 
repeatTISrepeatT 



65 textureTransform Texture Transform{ 
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5 center IS centerTexture 

rotation IS rotationTextiire 
scale IS scaleTexture 
translation IS translationTexture 

} 

10 } # Appearance 

geometry Box { 

size IS size 

} 

> 

15 TouchSensor 

{ 

enabled IS enabled 
isActive IS isActive 
isOver IS isOver 

20 touchTime IS touchTime 

hitPoint changed IS hitPoint changed 

} 

Group 
{ 

25 removeChildren IS removeChildren 

addChildren IS addChiJdren 
children IS children 

} 

] #childrerv 

30 DEF TIMER TimeSensor { 

enabled IS animationEnabled 
loop TRUE 

cyclelnterval IS animationDuration 

} 

35 

DEF INTERPOLATOR Orientationlnterpolator{ #fbr rotation 
key [0,.333333,.666667, 1] 

key Value [0 1 0 0,0 1 0 -2.09439,0 1 0 -4.18879,0 1 0 -6.28318] 

> 

40 ROUTE TIMER.fraction_changed TO mTERPOLATOR.set fraction 

ROUTE INTERPOLATOR.value_changed TO TRANSFORM.setjrotation 



45 



} #transf orm 
}#proto definition 



Table 2 below is an example of the component interfaces 33 1 of the present 
invention. The example is not intended to be a compilable or executable program, 
a completed program language or contain all the features discussed herein, but is 
illustrative of various functions and processes of the method of the present 
50 invention. 



Attorney Docket No. :PLAT1 005MCF/MAM 
mam/plat/1005/1 005.006 



Express Mail No.TB687081879US 



-23 - 



TABLE 2 



Component Interfaces: 

10 object, 

uuid(A20A988C-B7FC-llDl-BOA6-OOA024CBE637), 
dual, 

helpstringC'IGSdGroup Interface"), 
poMter_default(unique) 

15 ] 

interface IG3dGroup : IUnknown 
{ 

[id(l), helpstringC'metbod AddChild")] 

HRESULT AddChild(LPUNKNOWN pObj); 
2 0 [id(2) 5 he]pstring("method GetChild")] 

HRESULT GetChild(int ids; LPUNKNOWN* ppObj); 
[id(3), helpstring("method RemoveChild")] 

HRESULT RemoveChild(intidx); 
[id(4), helpstring("method RemoveChildByRef')] 
25 HRESULT RemoveChttdByRef^PUNKNOWN pUnk); 

[id(5), helpstring( n method RemoveAilChiidren")] 

HRESULT RemoveAllChildrenO; 
[id(6), helpstring( M method RenderChildren")] 

HRESULT RenderChildren(IG3dContext* pContext); 
3 0 [id(7) 5 heIpstring("metiiod GetNumChildren")] 

HRESULT GetNumChildren(int* pNum); 

[* 

object, 

3 5 uuid(42D25EC0-B98F-l ldl-B0A6-00 A024CBE637), 

dual, 

helpstring("IG3dColoredObj Interface"), 
pointer _default(unique) 

40 interface IG3dColoredObj : IUnknown 

{ 

[propget, id(l), helpstringC'property DiffuseColor")] 

HRESULT DiffiiseColor([out, retval] OLECOLOR *p Val); 
[propput, id(l), helpstring("property DiffuseColor")] 
45 HRESULT DiffuseColor([in3 OLE_COLOR newVal); 

[propget, id(2), helpstringC'property Ambientlntensity")] 

HRESULT AmbientIntensity([out, retval] float *pVal); 
[propput, id(2), helpstringC'property Ambientlntensity")] 

HRESULT Ambientlntenshy([in] float newVal); 
50 [propget, id(3), helpstringC'property EmissiveColor")] 

HRESULT EmissiveColor([out, retval] OLE COLOR *pVal); 
[propput, id(3), helpstringC'property EmissiveCoior")] 

HRESULT EmissiveColor([in] OLE_COLOR newVal); 
_ _ [propget, id(4), helpstring("property Shininess")] 

^ HRESULT Sluniness([out, retval] float *pVal); 

[propput, id(4), heIpstring("property Shininess")] 

HRESULT Shininess([in] float newVal); 
[propget, id(5), he!pstring("property SpecuIarCoior")] 
„ HRESULT SpecularColor([out, retval] OLE_COLOR *pVaI); 

0U [propput, id(5), helpstringC'property SpecuIarCoior")] 

HRESULT SpecularColor([in] OLE_COLOR newVal); 
[propget, id(6), helpstringC'property Transparency")] 
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H RESULT Transparencyflout retval] float *pVal); 
[propput id(6) a helpstring("proper1y Transparency")] 

HRESULT Transparency([in] float newVal); 



object, 

uuid(D198B9A0-BA67-lldl-B0A6-00A024CBE637) 5 
dual, 

helpstritog( M IG3dTransfommbleObj Interface"), 
pointer_default(iinique) 

interface IG3dTransformableObj : IUnknown 

[propget id(l), helpstringC'property Center")] 

HRESULT Center([out, retval] LPUN KNOWN *pVal); 
[propput id(l), helpstringC'property Center")] 

HRESULT Center([in] LPUNKNOWN newVal); 
[id(2), helpstring(''method put_Rotation")] 

HRESULT put_Rotation(LPUNKNOWN pRot); 
[id(3), helpstring("method get_Rotation")] 

HRESULT get_Rotation(IG3dRotation** pRot); 
[propget id(4), helpstringC'property Scale")] 

HRESULT Scale([out retval] LPUNKNOWN * P Val); 
[propput, id(4), helpstringC'property Scale")] 

HRESULT Scale([iti] LPUNKNOWN newVal); 
[id(5), helpstring("niethod put_ScaleOrientation")] 

HRESULT put_ScaleQrientation(LPUNKNO WN pRot); 
[10X6), helpstring("method getScaleOrientation")] 

HRESULT get_ScaleOrientation(IG3dRotation** ppRot); 
[propget id(7), helpstringC'property Translation")] 

HRESULT Translation([out, retval] LPUNKNOWN *pVai); 
[propput, id(7), helpstringC'property Translation")] 

HRESULT Translation([in] LPUNKNOWN newVal); 
[propget, id(8), helpstringC'property BBoxCenter")] 

HRESULT BBoxCenter([out, retval] LPUNKNOWN *pVal); 
[propput, id(8), helpstringC'property BBoxCenter")] 

HRESULT BBoxCenter([in] LPUNKNOWN newVal); 
[propget id(9), helpstringC'property BBoxSize")] 

HRESULT BBoxSize(fout retval] LPUNKNOWN * P ValV 
[propput id(9) 5 helpstringC'property BBoxSize")] 

HRESULT BBoxSize([in] LPUNKNOWN newVal); 
[propget id(10), helpstringC'property ScaleFactor")] 

HRESULT ScaleFactor([out retval] LPUNKNOWN *pVal); 
[propput id(10), helpstringC'property ScaleFactor")] 

HRESULT ScaleFactor([in] LPUNKNOWN newVal); 



object 

uuid(889ED240-CE15-lldl-B0A6-00A024CBE637), 
dual, 

helpsteingCTG3dTexture Interface"), 
pointer_default(unique) 

interface IG3dTexture : IUnknown 
{ 

[id(l), helpstring("method putCenter")] 

HRESULT put_Center(float x, float y); 

[id(2), helpstringC'method get_Center")] 

HRESULT get_Center(float* x, float* y); 

[propget id(3), helpstringC'property Rotation")] 

HRESULT Rotation([out retval] float *pVaI); 
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5 [propput, id(3), helpstringC'property Rotation")] 

HRESULT Rotation([in] float newVal); 
[id(4), helpstringC'method putScale")] 

HRESULT putjScale(float x, float y); 
pd(5), helpstringC'method getScale")] 
10 HRESULT get Scale(float* x, float* y); 

[id(6) 5 helpstringC'method putTranslation")] 

HRESULT put_Traiislation(float x, float y); 
[id(7) a helpstringC'method get_Translation")] 
1 . HRESULT get_Translation(float* x, float* y); 

1D helpstring("method SetTextureType")] 

HRESULT SetTextureType(int iType); 
[propget, id(9), helpstringC'property Url")] 

HRESULT Url([out, retval] BSTR *pVal); 
on [propput, id(9), helpstringC'property Url")] 

2U HRESULT Url([in] BSTRnewVal); 

[propget, id(10), helpstring("property Repeats")] 

HRESULT RepeatS([out, retval] BOOL *pVal); 
[propput, id(10), helpstringC'property Repeats")] 
7 ^ HRESULT Repeats ([in] BOOL newVal); 

25 [propget, id(l 1), heIpstring("property RepeatT")] 

HRESULT RepeatT([out, retval] BOOL *pVal); 
[propput, id(ll), helpstring("property RepeatT")] 

HRESULT RepeatT([in] BOOL newVal); 
- - [id(12) ? helpstringC'method GetTextureType")] 

3v HRESULT GetTextureType(int* piType); 

interface IG3dPickable : IUnknown 

{ 

~ - [propget, id(l) a helpstring("property PickHandler")] 

j ^ HRESULT PickHandler([out, retval] LPUN KNOWN *p Val); 

[propput, id(l), helpstringC'property PickHandler")] 
^ HRESULT PickHandler([in] LPUNKNOWN newVal); 

40 [ object, 

uuid(CC5C92C0-DDF5-lldl-B0A6-00A024CBE637X 
dual, 

helpstring("IG3dPickHandler Interface"), 
^ pointer_defau!t(unique) 

interface IG3dPickHandler : IUnknown 

{ 

[id(l), helpstringC'method OnPick")] 
50 HRESULT QnPick(WORD wMouseMsg, LPUNKNOWN pUnkObj); 

f 

object, 

uuid(48DE9F34-DE24-llDl-A2FC-0000C0D05EF9) 
dual, 

J J helpstring( , 'IG3dColorBvr Interface"), 

pointer_default(unique) 



60 



Table 3 below is an example ofthe other component interfaces 335 of FIG. 4 that 
enable a user to extend the component interfaces 33 1 . The example is not intended 
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to be either a compilable or executable program, a complete program language or 
contain all the features discussed above. It is a VRML illustrative of the various 
functions and processes implemented in the method of interfacing of the present 
invention that is consistent with the principals of the above-described invention. 
The other component interfaces 335 generally include the following extensions: a 
smartproperty list, a smartproperty, a smartwidget, a smartfactory, a property, a 
propertylist, an extension and an extensionfactory, as more fully detailed in the 
Table 3 below. The use of these extensions is to provide additional interfaces to the 
application programmer other than the component interfaces 332-334, 336, 338, 
thereby making the interfaces more expandable. The manner of making these 
extensions is detailed in Table 3. 



TABLE 3 



Other Interfaces: 

// SmartView.idl : IDL source for SmartView.dll 

// 

// This file will be processed by the MHJL tool to 

// produce the type library (SmartView.tlb) and marshalling code. 

import "oaidl.idl"; 
import "ocidl.idl"; 



object, 

imid(4E08E3E3-9 17D-1 1DI-A290-OOC04FB6CD35), 
dual, 

helpstring("IMFString Interface"), 
pointer_default(unique) 
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5 ] 

interface IMFString : IDispatch 

i 

[id(l), helpstringC'method SetValue")] HRESULT 
SetValue([in] BSTR bstrNewValue, short ulndex); 
1 0 [i<*(2), helpstringC'method GetCount")] HRESULT 

GetCount([out, retval] short* pCount); 

[id(3), helpstringC'method GetValue")] HRESULT GetValue([in] 
short ulndex, [out, retval] BSTR* pStringOut); 

}; 

15 [ 

object, 

uuid(6~2D197A0-0ABF-l 1D2-A29 1-00C04FB6CD35), 
dual, 

helpstring("ISnwtProperty Interface"), 
20 pointer_default(unique) 

3 

interface ISmartProperty : IDispatch 
{ 

[id(l), helpstringC'method GetName")] 
25 HRESULT GetName([out, retval] BSTR* pstrPropertyName); 

[id(2), helpstringC'method GetDescription")] 
HRESULT GetDescription([out, retval] BSTR* pstrPropertyDesc); 

[id(3), helpstring("method SetValue")] 
HRESULT SetValue([in] VARIANT vDataValue); 
30 [id(4) 5 helpstring("method GetValue")] 

HRESULT GetValue([out] VARIANT* pDataValueOut, 
[out, retval] short* psFieldType); 
[id(5), helpstring("method Advise")] 
HRESULT Advise([in] IUnknown* pSmarfNotif^ink); 
3 5 [id(6), helpstringC'method Unadvise")] 

HRESULT UnadviseO; 

[id(7), helpstringCmethod GetFieidType")] 
HRESULT GetFieldType([out,retval] short* pFieldType); 

[id(8), helpstringCmethod GetPropertyType")] 
40 HRESULT GetPropertyTypeCtout^retval] short* pPropertyType); 

>; 
[ 

45 object, 

uuid(344AC98A-EFC4-llDl-A291-00C04FB6CD35), 
dual, 

helpstring("ISmartPropertyList Interface"), 
pointer_default(unique) 

50 ] 

interface ISmartPropertyList : IDispatch 

{ 

[id(l), helpstring( ,, method GetCount")] 
HRESULT GetCount([out, retval] short* pPropertyCount); 
5 5 [id(2) s helpstrmg("method GetNameByuidex")] 

HRESULT GetNameByIndex([in] short slndex, 
[out, retval] BSTR* pstrPropertyName); 
[id(3), helpstringC'method GetNames")] 
HRESULT GetNames([out^etval] IMFString** ppNames); 
60 [id(4), helpstringC'method GetDescription")] 

HRESULT GetDescription([in] short slndex, 
[out^etval] BSTR* pstrDescription); 
[id(5), helpstringC'method GetDescriptionByName")] 
HRESULT GetDescriptionByName([in] BSTR strPropertyName, 
65 [out, retval] BSTR* pstrPropertyDesc); 
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5 [id(6), helpstring( M method GetProperty")] 

HRESULT GetProperty([in] short slndex, 

[ouUetval] ISmartProperty** ppProperty); 
[id(7), helpstringC'method GetPropertyByName")] 
HRESULT GetPropertyByName([in] BSTR strPropertyName, 
10 [out^retval] ISmartProperty** ppProperty); 

[id(8), helpstringC'method GetPropertyType")] 
HRESULT GetPropertyType(short slndex, short *pFieldType); 

}; 

[ 

15 object, 

uuid(344AC980-EFC4-llDl-A291-00C04FB6CD35), 
dual, 

helpstringC'ISmartWidget Interface"), 
p ointer_default(uni qu e) 

20 3 

interface ISmartWidget : IDispatch 
{ 

[id(l) s helpstring("method Shutdown")] 
HRESULT ShutdownO; 
25 [id(2), helpstringC'method GetPropertyList")] 

HRESULT GetPropertyList([out, retvai] 
ISmartPropertyList** ppPropertyList); 

[id(3), helpstringC'method Initialize")] 
HRESULT Initialize^); 
30 [id(4), helpstringC'method GetChiidCount")] 

HRESULT GetChildCountQout, retvai] short* psCount); 

[id(5), helpstringC'method GetChiid")] 
HRESULT GetChild([in] short slndex, 

[ouUetval] ISmartWidget** ppChildWidget); 
35 [id(6) 3 helpstringC'method AddChild")] 

HRESULT AddChild(tin] BSTR strSourceUrl, 
[in] BSTR strDefName, 
[out, retvai] ISmartWidget** ppChildWidget); 
[id(7), helpstringC'method GetName")] 
40 HRESULT GetName([out, retvai] BSTR* pstrWidgetName); 

[id(8), helpstringC'method GetVRMLString")] 
HRESULT GetVRMLString([out, retvai] BSTR* pstrVRML); 

[id(9) 5 helpstringC'method AddChild2")] 
HRESULT AddChild2([in] ISmartWidget* pChildWidget); 
45 [id(10), helpstring( M method GetPropertyByName")] 

HRESULT GetPropertyByName([in] BSTR strPropertyName, 
[out,retval] ISmartProperty** ppProperty); 
[id(l 1), helpstringC'method RemoveChild")] 

HRESULT RemoveChild(short slndex, ISmartWidget **pRemoved); 

50 }; 

[ 

object, 

uuid(DCCBEA22-2AEE-llD2-A298-00C04FB6122D), 
55 dual, 

helpstring(''ISmartFactory Interface"), 
pointer_default(unique) 

] 

interface ISmartFactory : IDispatch 
60 { 

[id(l), helpstringC'method CreateBlankWorldWidget")] 
HRESULT CreateBlankWorldWidget([ 

[ouUetval] ISmartWidget **ppWorldWidget); 
[id(2), helpstringC'method CreatFieldType")] 
65 HRESULT CreateFieldType([in] short sFieldType, 
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5 [out,retval] IUnknown **ppNewField); 

[id(3), helpstringO'inethod CreateSnrartExtension")] 
HRESULT CreateSmartExtension([in] BSTR lpGuid, 
[out^retval] IUnknown **pSmartEx); 
[id(4), helpstring("method CreateSmartWidgef)] 
10 HRESULT CreateSmartWidget([in] BSTR bsUrl, 

[in] BSTR bsDefName, [in] BSTR bdFieldValues, 

[out,retval] ISmartWidget **ppNewWidget); 

>; 



15 



20 



typedef 
[ 

uuid(5C6BD5 A0-E653-1 ldl-A29 1-00C04FB6CD35), 
helpstring("Field Type constants") 



] 

enum { 

[helpstringC'Unknown Field Type")] 
UnknownTyp e — 0, 

25 [helpstring("SFBool Field Type")] 

SFBool - 1, 

[helpstring("SFlmage Field Type")] 
SFImage = 2, 

[helpstring("SFTime Field Type")] 

30 SFTime = 3, 

[helpstring("SFColor Field Type")] 
SFColor = 4, 

[helpstringC'MFColor Field Type")] 
MFColor = 5, 

3 5 [helpstring("SFFloat Field Type")] 

SFFloat = 6, 

[helpstring("MFFloat Field Type")] 
MFFloat = 7, 

[helpstring("SFInt32 Field Type")] 

40 SFInt32 = 8, 

[helpstring("MFlnt32 Field Type")] 
MFInt32 = 9, 

[helpstringC'SFNode Field Type")] 
SFNode - 10, 

45 [helpstring("MFNode Field Type")] 

MFNbde =11, 
[helpstring("SFRotation Field Type")] 
SFRotation = 12, 

[helpstringfMFRotation Field Type")] 

50 MFRotation 13, 

[helpstring("SFString Field Type")] 
SFSIring = 14, 

pielpstringC'MFString Field Type")] 
MFString =15, 

55 [helpstring("SFVec2f Field Type")] 

SFVec2f = 16, 

[heJpstring("MFVec2f Field Type")] 
MFVec2f = 17, 

[helpstring("SFVec3f Field Type")] 

60 SFVec3f = 18, 

Pieipstring("MFVec3f Field Type")] 
MFVec3f = 19, 

pielpstring("MFTime Field Type")] 
MFTime -20 

65 } FieldTypes; 
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I interface IGSdPropcrty : IUnknown 
{ 

HRESULT Initialize(LPUNKNOWN pObject, BSTR strName, BSTR strDesc,short sType, short g3dPropXd); 
10 HRESULT ExtensionObject([out, retval] LPUNKNOWN *pVal); 

HRESULT ExtensionObject([in] LPUNKNOWN newVal); 
HRESULT GetS1ringValue(BSTR* newVal); 
HRESULT SetValue([in] VARIANT vDataValue); 

HRESULT GetValueflput] VARIANT* pDataValueOut, [out, retval] short* psFieldType); 
1 5 HRESULT GetName([out, retval] BSTR* pstrPropertyName); 

HRESULT GeiDescriptionQput, retval] BSTR* psirPropertyDesc); 
HRESULT GetFieldType([out,retval] short* pFieldType); 
HRESULT GetPropertyType([out,retvaij short* pPropertyType); 

} 

20 interface IG3dPropertyList : IUnknown 

{ 

HRESULT GetCount([out, retval] short* pPropertyCount); 

HRESULT GetNameByIhdex([in] short sfcidex, [out, retval] BSTR* pstrPropertyName); 
HRESULT GetDescription([in] short slndex, [out,retval] BSTR* pstrDescription); 
25 HRESULT GetDescriptionByName(BSTR strPropertyName, BSTR* pstrPropertyDesc); 

HRESULT GetProperty([in] short slndex, [ouUetval] IG3dProperty** ppProperty); 
HRESULT GetPropertyByName( BSTR strPropertyName, IG3dProperty** ppProperty); 
HRESULT GetPropertyType(short slndex, short *pHeldType); 
HRESULT AddProperty(IG3dProperty* pProp); 

30 }; 

interface I G 3 dExtensi on : IUnknown 

{ 

HRESULT SetProperty Value(IG3dProperry* pProp, VARIANT vVarln); 
HRESULT GetPropertyValue(IG3dProperty* pProp, VARIANT* pVarOut); 
3 5 HRESULT GetPropertyList([out, retval] IGSdPropertyList** ppPropertyList); 

HRESULT G3dObject([out, retval] LPUNKNOWN *pVal); 
HRESULT G3dObject([in] LPUNKNOWN newVal); 

HRESULT GetPropertyByName(BSTR strPropertyName, IG3dProperty** ppProperty); 

}; 

40 interface IG3 dExtensi onF actory : IUnknown 

{ 

HRESULT CreateG3dExtension(CLSID clid, BSTR bsUrl, IG3dExtension** ppObj); 

}; 
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FIG. 5 is a flow chart of the method of the present invention. At block 350, 
the first step of the method of the present invention includes defining a 3D object 
as a component with a component interface. In one embodiment, the defining step 
350 is performed in a three-dimensional content language, such as VRML, and 
50 includes the steps of defining the component in the three-dimensional content 

language and defining at least one property to describe the component. Examples 
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of the properties that describe the component may be found in Table 1 which is the 
3D content 300. The properties, sometimes referred to as fields in VRML, generally 
include color, shape, transformation, behavioral, event handling, and grouping. Also 
at step 350 is defined at least one route to interface the component with a second 
component (not shown). A second component may represent any other three- 
dimensional object other than the original three-dimensional object (e.g. cube 340 
of FIG. 4) to which a user wants to connect, or otherwise move the second 
component in relation to the original component. The routes include events and 
actions. An event is a message that is sent by a specific object in the 3D Content 
300. An action receives that message and performs a function based the event 
received. The route is a mechanism that connects the event to the action. The 
properties and routes of the present invention are all included in the 3D content 300 
of FIG. 4 (Table 1) and are considered "intelligent" content. That is, the 3D content 
needs no additional scripting to define the content or provide interface with the 3D 
content. Thus, the 3D content, or VRML describing the three-dimensional object, 
is considered "intelligent" when all the properties, routes, and definitions are 
provided within the 3D content 300 or VRML itself This is unlike other 3D 
languages which require external scripting to create to content as well as external 
scripting to interface with the 3D content or with other applications and as such are 
not considered "intelligent." 
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Returning to FIG. 5, the next step 360 displays the component interfaces 
33 1 of FIG. 4. The display is typically done on a monitor of a computer system but 
may also be displayed on any type of display means that may display a three- 
dimensional object. Such devices include CRT, LCD, a computer screen, a 
television, a projection screen and the like, or any other display device where 
digitally rendered representations are presented visually. The displaying step 360 is 
an important step in the practical implementation and function of the present 
invention that transforms the method of the present invention into an interfaceable 
means with a user. As such, the computer program is a practical application for 
interfacing with a three-dimensional object and acts as a programmed computer that 
functions as an interface between a user and a 3D object, without having to know 
the program language, e.g. VRML, of the 3D content. The computer has thus, 
through the method of the present invention, been transformed into an interface with 
complicated VRML. 

The next step of FIG. 5 of the method of the present invention includes 
interfacing with a three-dimensional object through the component interfaces. The 
interfacing is performed, in one embodiment, by first providing a plurality of the 
component interfaces to the user on a display and then the user selects one of the 
plurality of the component interfaces to access the 3D intelligent content 300 (FIG. 
4). The user is able to select one of the plurality of the component interfaces 
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through, in one embodiment, the interface devices of the computer system of FIG. 
3 including an alpha-numeric keypad or a pointing device such as a mouse, trackball, 
stylus, cursor or direction keys. The application developer or user is thereby able 
to interface with the three-dimensional object through the selected one of the 
plurality of component interfaces. 

In another embodiment, the present invention may be implemented using a 
conventional general purpose computer, such as the computer system of FIG. 3, or 
a specialized digital computer or microprocessor programmed according to the 
teachings of the present disclosure, as will be apparent to those skilled in computer 
art. Appropriate software coding can readily be prepared by skilled programmers 
based on teaching of the present disclosure, as will be apparent to those skilled in 
the software art. The invention may also be implemented by the preparation of the 
application specific integrated circuits or by interconnecting an appropriate network 
of conventional component circuits, as will be readily apparent to those skilled in the 
art. 

In a further embodiment, the present invention also includes a computer 
program product which is a storage medium (media) having instructions stored 
thereon/in which can be used to program a computer to perform the method of 
interfacing of the present invention. The storage medium can include, but is not 
limited to, any type of disk including floppy disks, optical disks, DVD, CD ROMs, 
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magnetic optical disks, RAMs, EPROM, EEPROM, magnetic or optical cards, or 
any type of media suitable for storing electronic instructions. On such 
medium/media, the computer program, 3D content, EAI and COM wrapper of FIG. 
4 may be electronically stored. 

Stored on any one of the computer readable medium (media), the present 
invention includes software for controlling both the hardware of the general 
purpose/specialized computer or microprocessor, and for enabling the computer or 
microprocessor to interact with a human user or other mechanism utilizing the 
results of the present invention. Such software may include, but is not limited to, 
device drivers, operating systems and user applications. Ultimately, such computer 
readable media further includes software for performing the method of interfacing 
of the present invention as described above. 

In a still further embodiment, the present invention also includes an 
apparatus for interfacing with a three-dimensional object that is displayed. A three- 
dimensional object is displayed on a monitor or other displaying means as described 
above, including a CRT display, LCD display, computer monitor, a screen, a 
projection device or the like. The apparatus first includes a means for defining the 
three-dimensional object as a component. Such means includes any type of disk 
including floppy disks, optical disks, DVD, CD ROMs, magnetic optical disks, 
RAMs, EPROM, EEPROM, magnetic or optical cards, or any type of media 
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suitable for storing electronic instructions. The electronic instruction stored in that 
defining means includes the 3D content 300, EAI 3 15, computer program 3 10 and 
COM wrapper 320, in one embodiment. The apparatus further includes, in this 
embodiment, a means for displaying the component interfaces 331. The means for 
displaying the component interfaces is typically a monitor; however, other displaying 
means may be used, including a CRT display, LCD display, computer monitor, 
television monitor, other monitors, a screen, a projection device or the like. 

The apparatus of the present invention fiirther includes a means for 
interfacing with the 3D object through the component interfaces. Such interfacing 
means includes a display means, as described above, to view the 3D object, storage 
means to store the 3D content 300, EAI 315, computer program 310, and COM 
wrapper 320 and a processor 230. In another embodiment, the interfacing means 
may further include an alpha-numeric keypad for inputting alpha-numeric and other 
key information, or a pointing device, such as a mouse, a trackball, stylus, or cursor 
direction keys. 

In another embodiment, the method of the present invention may be 
performed over a data network. That is, the defining step 350 of FIG. 5 defines the 
three-dimensional object as a component in a three-dimensional content language, 
where the component has component interfaces and intrinsically has intelligent 
content. The displaying step 360 of displaying the component interfaces is then 
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performed by transferring an electronic signal over a network (e.g. a data network 
such as the Internet, a frame relay network, an ATM, or even a local area network 
that transfers the electronic signal over such network). The electronic signal 
transfers, for example, the 3D content 300, the computer program 310, the COM 
wrapper 320 and the EAI 315 over the network. It is understood, however, that 
one or more of these items may be transferred over the network alone, or in 
conjunction, and achieve the method of the present invention as claimed below. 
Once the electronic signal has been transferred over the network, the interfacing 
step 370 maybe performed of interfacing with the 3D object through the component 
interfaces using the interfacing means and substeps of interfacing previously 
described above with regard to other embodiments. It is important to understand 
that merely transferring the computer program 310 and related items over a 
network, rather than as part of a computer system, such as shown in FIG, 3, does 
not avoid the scope of the present invention as claimed below. 

Obviously, numerous modification and variations of the present invention are 
possible in light of the above teachings. It is therefore to be understood that within 
the scope of the attended claims, the invention may be practiced otherwise than 
specifically described herein. 
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CLAIMS 

What is claimed is: 

1 . A method of interfacing with a three-dimensional object that is displayed, 
said method comprising the steps of: 

defining said three-dimensional object as a component with a component 
interface, said component intrinsically containing an intelligent 
content; 

displaying said component interface; and 

interfacing with said three-dimensional object through said component 
interface. 

2. The method of claim 1, wherein said defining step further comprises the 
steps of: 

defining said component in a three-dimensional content language; 
defining an at least one property to describe said component; and 
defining an at least one route to interface said component with a second 
component, so that said at least one property and said at least one 
route comprise a portion of said intelligent content. 
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3 . The method of claim 2, wherein said three-dimensional content language 
is a virtual reality modeling language. 

4. The method of claim 2, wherein said at least one property is selected from 
the group consisting of color, shape, transformation, behavioral, event 
handling and grouping. 

5 . The method of claim 2, wherein said at least one route is selected from the 
group consisting of event and action as an event model for the component. 

6. The method of claim 1, wherein said component interface is selected from 
the group consisting of group, pickabie, transformable, colorable and 
texture. 

7 . The method of claim 1 , wherein said component interface is selected from 
the group consisting of a smartproperty list, a smartproperty, a 
smartwidget, a smartfactory, a property, a propertylist, an extension and 
an extensionfactory. 

8. The method of claim 1, wherein said displaying step further comprises the 
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step of displaying said component interface on a cathode ray tube display. 

9. The method of claim 1 7 wherein said interfacing step further comprises the 
steps of: 

providing a plurality of component interfaces; 

selecting one of said plurality of component interfaces to access said 

intelligent content; and 
interfacing with said three-dimensional object through said selecting one 

of said plurality of component interfaces. 

10. An apparatus for interfacing with a three-dimensional object that is 
displayed, comprising: 

means for defining said three-dimensional object as a component with a 
component interface, said component intrinsically containing an 
intelligent content; 

means for displaying said component interface; and 

means for interfacing with said three-dimensional object through said 
component interface. 

1 1 . The apparatus of claim 1 0 3 wherein said defining means further comprises 
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a computer readable medium having a computer program stored therein. 

12. The apparatus of claim 10, wherein said displaying means further 
comprises a cathode ray tube display. 

13 . The apparatus of claim 1 1 ? wherein said computer program is written in 
a virtual reality modeling language, 

14. A computer system for interfacing with a three-dimensional object that is 
displayed, comprising: 

a means for displaying said three-dimensional object; 
a memory for storing a computer program for interfacing with a three- 
dimensional object displayed on said displaying means, said 
computer program executed to perform the steps of: 
defining said three-dimensional object as a component with a 
component interface, said component intrinsically 
containing an intelligent content; 
displaying said component interface on said displaying means; 
and 

interfacing with said three-dimensional object through said 
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component interface; and 
a processor for executing said computer program in conjunction with said 
monitor. 

15. The computer system of claim 14, wherein said defining step further 
comprises the steps of: 

defining said component in a three-dimensional content language; 
defining an at least one property to describe said component; and 
defining an at least one route to interface said component with a second 
component, so that said at least one property and said at least one 
route comprise a portion of said intelligent content. 

16. The computer system of claim 1 5, wherein said three-dimensional content 
language is a virtual reality modeling language. 

17. The computer system of claim 14, wherein said component interface is 
selected from the group consisting of group, pickable, transformable, 
colorable and texture. 

18. The computer system of claim 14, wherein said component interface is 
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selected from the group consisting of a smartproperty list, a 
smartproperty, a smartwidget, a smartfactory, a property, a propertylist, 
an extension and an extensionfactory. 

19. The computer system of claim 14, wherein said interfacing step further 
comprises the steps of: 

providing a plurality of component interfaces; and 
selecting one of said plurality of component interfaces to access said 
intelligent content. 

20. A computer readable medium having a computer program stored thereon 
that, when loaded into a computer, cause said computer to perform a 
function of interfacing with a three-dimensional object displayed on said 
computer, said computer interfacing with said three-dimensional object by 
performing the steps of: 

defining said three-dimensional object as a component with a component 
interface, said component intrinsically containing an intelligent 
content; 

displaying said component interface; and 

interfacing with said three-dimensional object through said component 
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interface. 

21. The computer readable medium of claim 20, wherein said defining step 
further comprises the steps of: 

defining said component in a three-dimensional content language; 
defining an at least one property to describe said component; and 
defining an at least one route to interface said component with a second 
component, so that said at least one property and said at least one 
route comprise a portion of said intelligent content. 

22. The computer readable medium of claim 21, wherein said three- 
dimensional content language is a virtual reality modeling language. 

23. The computer readable medium of claim 20, wherein said component 
interface is selected from the group consisting of group, pickable, 
transformable, colorable and texture. 

24. The computer readable medium of claim 20, wherein said component 
interface is selected from the group consisting of a smartproperty list, a 
smartproperty, a smartwidget, a smartfactory, a property, a propertylist, 
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an extension and an extensionfactory. 

25 . The computer readable medium of claim 20 ? wherein said interfacing step 
further comprises the steps of: 
providing a plurality of component interfaces; and 
selecting one of said plurality of component interfaces to access said 
intelligent content. 
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ABS TRACT 

A method of interfacing with a three-dimensional object that is displayed 
includes the steps of defining the three-dimensional object as a component with 
a component interface, displaying the component interface and interfacing with the 
three-dimensional object through the component interface. The component 
intrinsically contains an intelligent content. The present invention also provides 
for an apparatus with means for accomplishing the steps of the present invention 
as well as a computer system and computer readable medium implementing the 
method of the present invention. 
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